Papers with three-step approach
Large Language Models Are No Longer Shallow Parsers (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have reshaped the field of natural language processing (NLP) however, fundamental NLP tasks that involve linguistic analysis still play essential roles in the field. |
| Approach: | They propose to use constituency parsing to improve performance of LLMs on deep syntactic parse trees to prompt LLM chunking, filter out low-quality chunks and add remaining chunks to prompts to instruct LLM for parser. |
| Outcome: | The proposed approach improves LLMs' performance on constituency parsing on English and Chinese benchmark datasets. |
Instructive Dialogue Summarization with Query Aggregations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Conventional dialogue summarization methods generate summaries without considering user’s specific interests. |
| Approach: | They propose a three-step approach to synthesize high-quality query-based summarization triples by training a unified model on three summarizing datasets with multi-purpose instructive triples. |
| Outcome: | The proposed model outperforms state-of-the-art models and even models with larger sizes on four datasets including dialogue summarization and dialogue reading comprehension. |
Direct Fact Retrieval from Knowledge Graphs without Entity Linking (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to retrieve facts from Knowledge Graphs (KGs) require additional labels and may accumulate errors . |
| Approach: | They propose a framework that directly retrieves facts from KGs given input text based on their representational similarities. |
| Outcome: | The proposed framework outperforms baselines on multiple fact retrieval tasks. |
Select, Prompt, Filter: Distilling Large Language Models for Summarizing Conversations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) can be expensive to train, deploy, and use for specific natural language generation tasks. |
| Approach: | They propose a method to distill ChatGPT and fine-tune smaller LMs for summarizing forum conversations using a semantic similarity metric. |
| Outcome: | The proposed method leads to significant improvements of up to 6.6 ROUGE-2 score by leveraging sufficient in-domain pseudo-labeled data over standard KD approach given the same size of training data. |
RENN: A Rule Embedding Enhanced Neural Network Framework for Temporal Knowledge Graph Completion (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph embedding do not account for structural dependencies between relations. |
| Approach: | They propose a framework that enhances temporal knowledge graph completion through rule embedding. |
| Outcome: | The proposed framework improves temporal knowledge graph completion through rule embedding. |